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ON  LIMIT  OF  THE  LARGEST  EIGENVALUE  OF  THE 
LARGE  DIMENSIONAL  SAMPLE  COVARIANCE  MATRIX 


Y.  Q.  Yin,  Z.  D.  Bal,  and  P.  R.  Krlshnalah 

ABSTRACT 

In  this  paper,  the  authors  showed  that  the  largest  eigenvalue  of  the 
sample  covariance  matrix  tends  to  a  limit  under  certain  conditions  when 
both  the  number  of  variables  and  the  sample  size  tend  to  infinity.  The 
above  result  is  proved  under  the  mild  restriction  that  the  fourth  moment 
of  the  elements  of  the  sample  sums  of  squares  and  cross  products  (SP) 
matrix  exist. 
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1 .  INTRODUCTION 


The  distribution  of  the  largest  eigenvalue  of  the  sample  covariance 
matrix  is  useful  in  certain  problems  of  inference  in  the  area  of  multi¬ 
variate  analysis.  For  example,  it  is  useful  in  testing  the  hypothesis 
that  the  eigenvalues  of  the  covariance  matrix  are  equal  to  a  specified 


value.  Geman  (1980)  showed  that  the  largest  eigenvalue  of  A  =  WW' /n 
2 

tends  to  (1  +  /y)  almost  surely  when  lim  (p/n)  =  y,  W  =  '^ij'^ 

are  distributed  Independently  with  mean  zero  and  variance  one.  In 
proving  the  above  result,  Geman  assumed  that  e|wjj|^  ^  n^’^'  for  n  *  I,  2,... 

and  a  positive  constant  a.  Jonsson  (1983)  announced  the  above  result  under 
the  weaker  condition  that  E(lwjj^l^)  <  <»  by  using  a  "truncation"  method. 

Recently,  Silversteln  (1984)  proved  the  same  result  under  the  condition 
that  E|wjj|  ^  <  “  where  e  >  0  is  arbitrary.  In  the  present  paper,  we 
prove  the  above  result  under  a  much  weaker  condition  that  E|wjjI^  <  «. 


2 .  PRELIMINARIES 


The  following  results  are  needed  In  the  sequel: 
Lenma  2.1.  For  any  6  >  0,  we  have 


(1  +  /6) 


for  all  1  <  r  <  1  <  k,  where  =  n!/Tn!(n  -  m) ! . 
~  tn 


Proof.  Let 


I(r) 


■(:)I.M/ia 


for  r  *  0,  1 


Then,  we  have  for  r  *  0,  1,  2,...,1  -  1, 


.i. 


Kr  +  1) _ (2r  +  l)(k  -  r) 

I(r)  ■  [2(1  -  r)  -  l][k  -  (1  -  r)  +  1]  * 


But 


(2r  +  l)(k  -  r)  -  [2(1  -  r)  -  l][k  -  (1  -  r)  +  1] 
-  (2r  -  £  +  1) (2k  -  21  +  1)  >  0  if f  2r  >  1  -  1 . 

So  • 

^1  iff  2r  >  1  -  1. 

Hence  I(r)  has  its  maximum  at  1(0)  «  1(1),  and  so 


In  studying  strong  limit  properties  of  random  matrix,  the  techniques 
of  truncation  and  centralization  play  an  Important  role. 

Lemma  2.2.  (Truncation  Lemma).  Let  r  be  a  number  belonging  to  the 
interval  [-j,2]  and  let  j  ,  i,  j  *  1»  2,...}  be  a  collection  of  ild 

M  / 

random  variables  with  Ew, ,  ■  0  and  eIw,  ,|  <  ®.  For  each  n,  define 


to  be  p  X  n  matrix  whose  (l,j)th  entry  is  ,  where  p  »  p(n)  is  such 

that  p/n  ->•  y  e  (0,®)  as  n  Then  there  exists  a  sequence  of  positive 

numbers  5=6  such  that 
n 

(a)  6  -*■  0  as  n 

(b)  The  convergence  rate  of  5  can  be  slower  than  any  preassigned  rate, 

(c)  P(W^  +  W^.  i.o.)  -  0 

A  ^ 

where  W  is  the  p  x  n  matrix  whose  (i,j)-th  entry  is  w^^  =  |  <6n’^] 

and  I.  denotes  the  indicator  of  the  set  A. 

A 


Proof.  Since  E  w. 


<  we  have  for  any  e  >  0 


1  2  ®p(lwjjl  >  e2"*')  <  ~  . 
m=l 


Because  of  the  arbitrariness  of  e  in  the  above  inequality,  there  exists  a 
sequence  of  positive  numbers  e  =  such  that 

(1)  ■>  0,  when  m  -►  «, 

(2)  The  rate  of  convergence  is  slower  than  any  preassigned  rate. 


Define  6  ■  6jj  =  2e^  for  2*””^  ^  2™.  It  is  obvious  that  such  a  sequence 

A 

of  5  satisfies  the  requirements  (a)  and  (b) .  Define  with  this  6.  Because 
^  y,  0  <  y  <  we  have  p  ^  2yn  when  n  is  large  enough.  Thus 


1*  W^,  i.o.) 
n  n 


<  lim  f  P(  U  00<K,1  >  Sn’')) 
k-+®  m*k  2®”^<n<2”  ^ 


M  mIU  <«1D 

2y2“  2 


<  lim  ^  P(  O  O  ^l''ill  - 

k+«  n^k  2®“^<n<2™  ^  ^ 


-  2y2"'  2“ 

lim  I  P(CJ  O  I  S 

k->«  m-k  i-1  j-1 


2"”')) 


<  lim  2y  I  22”p(|wjj|  >  e„2®')  -  0 


which  completes  the  proof. 

Lemna  2.3.  (Centralization  Lenina)  Under  the  assumptions  of  Lemma  2.2 


we  have 


|X  (n)  -  X  (n)  I  — *■  0.  a.s. 
'  max  max  ' 


where  X  (n)  and  X  (n)  are  the  largest  eigenvalues  of  W  W*  and 
max  max  e>  a  2r  n  n 

1  -  -  n 

and  2'r^n^n *  the  n  n  matrix  whose  (i,j)th  entry 

is  w. .  -  Ew  . 

ijn  ijn 

Proof.  Denote  by  M  the  n  x  n  matrix  whose  entries  are  all  Ew, ,  . 
-  ^  n  lln 


Since 


we  obtain 


-  -  +  1 


X  (n)  -  X  (n) 
‘  max  max 


2  sup  la’W  M  a|  +  sup 

lUIl-l  ""  Half- 


n-^’^  J  2 


I  fa  Ilf  I 

p  i-1  ^  i-1  j-1  ^ 


Ewii^l  +  nlEWjj^l 


\  -i+i  -1+1  g  n  ,\l/2  -1+3  -A+2  , 

'  n  6  M  f  2  w^  )  +  n  6 

\i-i  j-1 


(  -i(r-l)2-l  -1+1 

<  c  <n  ^  6  ^ 


7'"'/-2r  f  ?  2',; 
a  2.  I  w..  1 

^  i-1  j-1 


2  2  4 

-f(r-l)M  --^+2 

+  n  6 


0,  a.s .  if  r  >  1 . 


-r  --+1  <22  2  2  \ 

n  n  I  I  "i  J 

V  1-1  i=l 


n  .  n1/2 


--(r-l)^-l  --+2 
+  n  6  ^ 


0,  a.s.  If  r  <  1. 


In  proving  the  above  result,  we  have  used  the  facts  that 


-2r  b  ^  2 

n  Z  1 

1-1  j=l 


0,  a.s.  lfr>l. 


-2  ?  r  2  2 

I  I  -*■  Ew  a.s.  If  r  1, 


1-1  j-1 

which  can  be  seen  from  Marclnklewlcz  strong  law  of  large  numbers. 

Remark  1.  Throughout  this  paper,  we  will  use  Leimas  2.2  and  2.3  with 
r  »  ■^,  and  the  requirement  (b)  Is  specified  as 

(b')  <5  log  n  -*■  »,  when  n  (2 

Remark  2.  From  Lemmas  2.2  and  2.3  we  can  easily  see  that 

X  (n)  -  X  (n)  — »•  0,  a.s.  as  n 
max  max 

if  the  conditions  of  Theorem  1  hold,  where  X  (n)  is  the  largest  eigen- 

IDdX 

value  of  W’ 
n  n  n 


3.  SOME  RESULTS  ON  GRAPH  THEORY 


Given  a  sequence  (ij^ ,  j  »  where  are 

Integers  in  the  set  p},  and  jj^*****^]^  Integers  in  the  set 

n},  we  define  a  directed  multigraph  as  follows.  We  draw  two 
parallel  real  lines,  I-line  and  J-line.  We  plot  ij^,...,lj^  on  the 
I-line  and  plot  J-line.  These  are  vertices  and  they 

are  split  into  two  disjoint  classes  on  the  two  parallel  lines.  So 
even  if  the  two  integers  i  and  j.  are  equal,  they  will  not  be  the 
same  vertex  because  i  belongs  to  I-line  and  j.  belongs  to  J-line. 

3  D 

But  if  i^  =  ij^  (or  j^  *  regard  these  two  vertices  identical. 

_ a. 

Edges  of  the  directed  blgraph  will  be  the  directed  segments 


^1^2’  ^2^2’  ^2^3*  “  * ’^k^k’  ^k^l*  number  and  they  should 

be  regarded  different  from  each  other,  even  in  the  case  when  two 
edges  have  the  same  initials  and  ends. 

Sometimes  it  is  convenient  to  denote  i^  by  V2^_j^  and  '^2a* 

So  the  vertices  of  the  graph  are  *  *  *  * ’^2k*  edges  are 

Vj^v^,  ^2'^3  ’  *  *  * ’'^2k-1^2k’  ^2k'^l’  when  we  write  an  edge  as 

v^v^^j^,  we  always  mean  that  v^  is  the  initial  vertex  and  is  the 

end  vertex,  the  direction  of  the  edge  is  from  v^  to 

When  two  edges  ^b^b+1  same  vertex  sets,  i.e. 

{v  ,v  =  (v,  ,v.  we  cannot  conclude  that  v  v  =  v.v.^,,  since 
a  a+1  b  b+1  a  a+1  b  b+1 

V  V  ■  v.v,  <*>  a  ■  b.  When  {v  ,v  «  (v,  ,v.j,},  we  say  that  the 
a  a+1  b  b+1  a  a+1  b  b+1 

two  edges  coincide. 

The  graph  we  just  constructed  will  be  called  a  W-graph. 

A  W-graph  will  be  called  canonical,  if  v  £  max{v  ,,v  ,,...}  +  1, 

for  each  a  >  2,  and  ■  1,  ^2  “  1. 

In  the  following,  we  will  get  a  bound  for  the  number  of  canonical 


W-graphs . 


In  a  canonical  W-graph,  an  edge  v  ,v  (a  >  2)  will  be  called  an 

a— 1  a  — 

innovation,  if  v  does  not  occur  in  v,,v-,...,v  Suppose  v  ,v  is 

a  12  a-1  a-1  a 

an  innovation.  If  a  is  odd,  v  ,v  is  called  a  row  innovation,  and  if 

a-1  a 

a  is  even,  a  column  innovation.  Note  that  v^v^  is  a  column  innovation 
according  to  the  above  definition. 

In  a  W-graph,  an  edge  v  -v  (a  >  2)  is  said  to  be  single  up  to  v. 

3“i  3  ”  D 

(b  >  a),  if  there  is  no  edge  v  ,v  with  1  <  c  <  b  such  that  v  ,v 
—  c-1  c  —  c-1  c 

coincides  with  v  ,v  .  An  edge  v,  -v  (b  >  3)  will  be  called  a  T_-edge 

3— j.  a  D  “  j 

if  there  is  an  innovation  v  ,v„,  single  up  to  v.  -,  and  v.  ,v.  , 

a— 1  a  b— 1  b— 1  b 

V  ,v  coincide. 
a-1  a 

An  edge  will  be  called  a  T^-edge  if  it  is  not  an  innovation  and 
not  a  T^-edge. 

A  consecutive  segment  v  v  . , . . .v.  -v,  of  the  whole  W-graph  will  be 

a  a+l  b— i  b  =  • 

called  a  chain. 

Lemma  3.1.  Let  v  v  . v  be  a  chain  such  that 

-  a  a+l  c 


(1)  single  up  to  v^. 


(2)  V  has  been  visited  by  v,v„...v  . 
c  1  2  a 

Then  the  chain  contains  at  least  one  T^-edge. 

Proof.  When  c-a  =  1,  evidently  v_v_.,  =  v  v  is  an  edge  of  T,  . 

3  3t  X  3  C  ^ 

We  know  that  v  ,v  must  be  a  T,  or  a  T_  since  it  cannot  be  an 
c-i  c  4  J 

innovation.  If  it  is  a  T^,  the  proof  is  completed.  If  v^  j^v^  is  a  T^, 

then  there  is  a  single  innovation  v,  ,v,  coincident  with  v  ,v  such 

b— 1  b  c— i  c 

that  b  <  c. 

Case  1.  b  >  a+l.  Since  v  -  v,  ,  or  v  ■  v,  ,  then  either 
-  —  c  b-1  c  b 

V  V  .,...v.  -  or  V  V  .,...v,  has  the  properties  (1),(2)  and  is  shorter 
a  a+l  b-1  a  a+l  b 

than  induction  hypothesis  contains  a  T^-edge 

but  It  is  a  part  of  the  chain  original  path  contains 


Case  2.  b  <  a+1,  i.e.  v.  ,v.  is  in  the  path  v,v„...v  .  and  then 
-  b— i  b  12a 

V  ,  =  (v,  or  V,  ,)  is  visited  by  v,v-...v  .  Thus  v  v  ,  has 

c-1  b  b-1  •'12a  a  a+1  c-1 

the  properties  (1),(2).  By  induction,  the  lenima  is  proved. 

Note;  In  a  W-graph,  the  chain  '^^''^2 *  * ''^a+l 

completely  whether  the  edge  is  an 

innovation,  a  or  a  T^. 

Lemma  3.2.  If  in  the  chain  ‘  ®  edges,  each  of  which’ 

is  single  up  to  v  and  has  a  vertex  equal  to  v  and  if  t  is  the  number  of 

o  S 

noncolncldent  T  edges  in  v  v  . . .v  ,  then  s  <  t  +1. 

4  12a  ~ 


Proof.  Let  v 


a, -la’  a.,  V+l’ 


, . . ,  V  V 


a  a+1 
s  s 


be  all  the  single  edges  such 


that  a,  <a_<...<a  <a  and  v  v  .,...y  v  .-.are  single  up  to  v  ,  and 

Z  Z  8  S 


Consider  chains  L-  -  v  v  . ,  . . .  v  »  v_  . -  . . .  v  ,  . . . , 

2  82  82+1  a^  j  a^  a^+i  a^ 

L  •  V  V  ....  V  .  By  Lemma  3.1,  L,  has  a  T,-edge  E«.  Let  v.  be 

S  3  3  rX  3  4*  H  fc  D  *1 

S  8  3 

the  first  vertex  in  L^  which  belongs  to  L2.  Then  by  Lemma  3.1 
V  V  . ,  ...  V,  contains  an  edge  of  T,  and  we  denote  it  by  E, . 

a^  a^+l  b^  =4  '  Z 

Evidently,  E^  and  E2  are  not  coincident.  Let  v^  be  the  first  vertex 

4 

of  L,  which  also  belongs  to  L- U  L- .  Then  v  v  .... .v.  has  an  edge 
4  ^  2  i  a^  a^+1  b^ 

of  T^,  by  Lemma  3.1.  Let  it  be  denoted  by  E^.  Evidently  no  two  of 
E2.E2,E^  are  coincident.  Continue  this  procedure.  Finally,  we  get 
s-1  edges  of  T^,  which  are  not  coincident  with  each  other.  So 
s-1  ^  t  ,  s  £  1+t  . 

A  Tj  edge  is  called  regular,  if  there  is  more  than  one 

innovation  with  a  vertex  equal  to  v  and  single  up  to  v  . 

Lemma  3.3.  In  any  W-graph  there  is  a  mapping  $  from  regular  T^ 
edges  to  T^  edges  such  that  for  any  T^  edge  E,  there  are  at  most  two 
regular  T.  edges  whose  ^  image  is  E. 


Proof.  Define  $  as  follows 


Let  V  V  .i,v  V  V  V  ..be  the  set  of  all  innovations 

a,  a,+l  a-  a-+l  a  a  +1 

11  2  2  s  s 

single  up  to  such  that 


(1)  V  =  V  = — =v  =  V 
a„  a.  a  a 

2  3  s 


(2)  V  =v  orv  .-,=v 

a^  a  a^^+l  a 

(3)  a^  <  a2  =  a. 

We  note  that  there  is  at  most  one  Innovation  inward  to  v  and  if  there 

a 

is  such  an  innovation,  it  must  be  the  foremost  one  among  innovations 

with  a  vertex  v  . 

a 

In  this  W-graph,  v  v  -  must  coincide  with  one  of  v  v  , . . .  ,v 

11  s 

Let  that  one  be  v  .v  Also,  let 

a*  a*+l 


V  =  v(a) 


i  +  1,  if  a*  =  a^,,  for  i  =  l,...,s-l, 
s,  if  a*  =  a^. 


By  Lemma  3.1,  in  the  path  C  »  v  v  .  ...  v  . .  ,  there  is  at 

®  3  V  ^  v''*' 

least  one  edge  of  T, .  Let  the  first  one  be  E  .  Define  iKv  v  .)  =  E  . 

At  first  we  prove  that  if  regular  edges 

and  V  V.  then  E  E,  (E  ,E,  may  coincide).  Suppose  C  =  v  ,v 

ab  aba  b  aa  a  +1 

C,  =  V,  ,v.  , . , . . .V, „ .  Then,  we  have  the  following  possibilities  to 
b  b  b  +1  b 

consider: 

(1)  a'  <  a"  <  b'  <  b". 


(2)  a'  <  b'  <  a"  <  b". 


(3)  a’  <  b'  <  b"  <  a". 


For  case  (1),  E  E,  is  evident, 
a  D 


Consider  case  (2)  .  C^,  are  divided  into  three  parts  as 

Ql  -  ''a'\'+l‘"^b”  ^2  “  '^b’^b*+l’**'^a"’  S  *  ^a"^a"+l *  *  *''b" 
in  the  following  diagram. 


It  is  enough  to  show  that  is  in  Qj^»  is  in  Q2U  Q3*  ®y 
definition,  there  is  an  Innovation  with  b*  <  b', 

single  up  to  v^.  If  b*  ^  a',  by  Lemma  3.1,  contains  a  T^-edge.  If 
a'  <  b*  <  b',  we  can  consider  the  chain  .  .v^^t ;  it  is  part  of 

Q,  and  it  contains  a  T^-edge  by  Lemma  3.1.  So  e  Qj^.  It  is 


obvious  that  Ej^  is  in  Q2y  Thus  E^. 


Consider  (3).  As  before,  we  can  show  that  E  is  in  v  ,v  1 . • ‘V, 

’  a  a  a  +1  b 


and  E^  is  in 


Iqj  “ 


Then  we  consider  the  case  v^  ••  v^  and  a  <  b.  Now  v^v  a+1’  ^b^b+1 
both  are  regular  T^  edges  and  so  they  coincide  with  single  innovations 

^a*''a*+l  ^b*V+l*  ^a*^*+l  coincide.  So 

E^  E^  except  %*^b*+l  single  Innovations. 

In  the  last  case  $  ^(E  )  has  cardinal  2. 


12 


4.  LIMIT  OF  THE  LARGEST  EIGENVALUE 


We  now  prove  the  main  result  of  our  paper. 

Theorem  3.1.  Let  ^  *  1,2,...}  be  an  infinite  matrix  of 

4 

iid  random  variables,  Ew, -  =  0  and  Ew, ,  <  “.  If  X  (n)  denotes  the 

11  11  max 

largest  eigenvalue  of  the  matrix  ^  here  denotes  the  p  x  n 

random  matrix  ;  1  •  l,...,p;  j  =  l,...,n],  then 

lim  X  (n)  =  (1  +  i/y)^  a.s. 

CDAX  X  X 

n-H« 

as  n  p  “  and  p/n  y. 

2 

Proof .  Without  loss  of  generality,  we  assume  that  =1.  We 

only  have  to  prove  that  11m  X^^^(n)  ^  (1  +  a.s.  .  But,  according 

to  Remark  2  of  Section  2,  it  is  sufficient  to  show  that 


11m  X  (n)  <  (1  -f  a.s.  . 


In  ocher  words,  we  ss-iume  In  Che  sequel  ChaC 


(1)  I  < 


, 


(2)  Ew^j  -  0, 


(3)  Ew‘j  1  1, 


(4)  eIw^jT  <  ,  for  £  >  2, 

(5)  e|w^j|^  1  c(6v^)^~^  ,  for  £  >^  3. 


Now,  choose  z  >  (1  +  /y  )  arbitrarily.  We  will  now  show  that 
k 


(6)  [  E 

n*l 


X  (n) 
max 


<  « 


where  k  *  k  satisfies 
n 


(7)  k^  /  log  n 


(8)  6^^®k^/logn  - »■  0. 


We  have 


E[A  (n)  <  E  tr(-  W  E  tr(W 

max  —  n 

-k  r 

“  n  >  E  w.  ,  w,  .  w .  ,  . . .  Wj  .  . 

Vi  ‘2^1  V2  Vk  4^k 

Here  the  summation  is  taken  in  such  a  way  that  ij^,...,ij^  run  over  all 
integers  in  {l,...,p}  ,  and  J2.**‘**'^k  <>ver  all  Integers  in 
Cl}**«fn}« 

The  above  sum  can  be  split  in  the  following  form. 


E  tr( 


W  W^)‘'  -  n"®"  II  J  ^  "i  i  "i  1  •"’'ll  ”i 

Vl  ^2^2  Vk 


,»  1 1 


^  -  summation  for  different  arrangements  of  four  different  types 

of  elements  at  the  2k  different  positions. 

• 

2,  -  summation  for  different  canonical  graphs  T  with  given 

arrangement  of  the  four  types  for  2k  positions, 
r'  ” 

I  -  summation  of  E  w,  .  w  ...  w  .  for  which  the  graph  is 

^iJ  1  ^2^  1  ^1^  k 

isomorphic  to  the  given  canonical  graph. 

Let  r  denote  the  number  of  row  Innovations,  I  denote  the  number 

of  edges.  Then  there  are  -  r  column  innovations  and  (2k  -  21) T^ 
r '  r  r  fkl  f  k  I  r2k-)l'l 

edges  and  so  l  is  bounded  by  ^  ^  0  *  Since  every  row 

1-1  r-1 

innovation  leads  to  a  free  1-lndex  and  every  column  innovation  leads  to 

a  free  J -index  except  the  first  column  innovation  v^v^  which  leads  to 

_  ?  1 1  r+1  £— r 

an  i-lndex  and  a  j  one.  We  know  that  2,  is  bounded  by  p  n 

f  f 

To  bound  ^  ,  let  t  denote  the  number  of  noncoincident  T^  edges. 


By  definition,  each  innovation  in  a  canonical  U-graph  is  uniquely 
determined  by  the  chain  before  it  and  each  nonregular  T_  edge  is  so 


done  as  innovations.  l.e.  then  by  Lenuna  3.3,  there 

^ '  • 

are  no  edge  and  regular  edge,  so  that  i  Is  only  one  sununand. 

For  t  ^  1,  since  each  edge  in  a  canonical  W-graph  must  be  one  of  the 
2 

k  elements  in  the  kxk  matrix  (w  )  i  ^  k,  j  ^  k,  all  the  possibilities 

^  f  2^ 

k  2k-2)^ 

that  2k  -  2£  edges  may  take  are  less  than  ^  t  -By  Lemmas  3.2 


and  3.3,  all  the  possibilities  that  all  the  regular  T3  edges  take  is 

4k-4t.  2k-2J,  4k-4!l 

not  more  than  (t+1)  .  Hence  \  is  bounded  by  ^  t  (t+1) 


(t+1) 


6k-6il 


Finally,  we  bound  the  expectation  E  w.  ,  w.  ,  . . .  w .  ,  w.  .  . 

^iJ  1  1  k  ^1'^  k 

2  it 

If  t  *  0,  each  expectation  is  (E  £  1*  For  t  ^  1,  let  p  denote 

the  number  of  innovations  which  coincide  with  at  least  one  edge  and 

let  n^  denote  the  number  of  T,  edges  which  coincide  with  the  1-th  such 
i  4 

innovation,  i  =  1,2, ...,p,  respectively. 


Let  m^  be  the  number  of  edges  which  coincide  with,  each  other 
but  not  with  any  innovation,  j  =  l,2,...,t-y.  Then  we  have 

' 

V  t-y 

where  2()l-y)  +  I  (n  +  2)  +  I  m  -  2k  and  y  £  t.  By  (3),  (4)  and 
i-1  ^  j*l  ^ 

(5)  we  have  y  t-y 


c^(6^) 


y  t-y 

I  (n  -1)+  I  (m  -1) 
1-1  ^  j-1  ^ 


when  k  is  large  enough. 

By  the  above  argument,  we  obtain 


.1  ,,  „T.^  -k  f  f  k  (  k  llZk-J,  r+1  .( 

I  I  r  U-r  H  P  n  [  ^  k  (t+1) 
A-l  r=l  V  I  t=0 


k  I 


k^6^) 


i-1  r-1  ^  t=0 

-t  b  r  b  1  ^ 

Using  the  elementary  inequality  a  (t+1)  _<  for  a  >  1,  b  >  0 


r  2k-2 


,2(k-£) 


t  >  0,  we  have 


2k-2i  ,,  ,  6k-6!l 

y  k^'^Ct+l)^’^"^*^  (6v^)  <  2k  ,  6/n 

t=0  lo8  2 

k 


6k-6)l 


log  n  +  log  6-3  log  k 


6(k-!l) 


<  2k  f^l 

-  (.lognj 


6(k-£) 


when  n  is  large  enough. 


Using  Lemma  2.1,  we  get  for  all  large  n 


1  T  k 
E  tr(-  W  W^)*^ 
n  n  n 


<  2KP  (^)  (“)(£] 


^  log  n  ^ 


<  2kp  (l+y^)^*"  (d+v^)^  +  [ 


*  (Zkp)^/'"  (1+y^)^  (d+v^)?  +  [  ]S  ^ 


log  n 


k 

1  n  » 


2 

where  n  is  a  constant  satisfying  (l+/y)  <  n  <  z.  Here  the  last 


inequality  follows  from  the  following  facts: 


(^)  (2kp)^ 


1,  because  k/logn  - ►  ®  and  p/n  - ►  y  e  (O,*) 


(b)  (1+*^)“^ - -  If  because  6 


(c)  (1+^)'^- 


2 

(l+/yr,  because  p/n  - ►  y  e  (0,») 


log  n 


0,  because  6^^^k  /  logn 


This  leads  to  (6)  since  k/log  n  •  and  the  proof  is  thus  complete. 


m.F  a.  k  ’•.  4  '^m*L  •_*.  S^  •_  t  L'»  **■  U  J»  -  • 
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